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Abstract of JP8153148 

PURPOSE: To reduce the influence of an 
offset by calculating variation of an energy 
function by using the difference between the 
error signal when ail pulses are absent, and 
the error signal when one pulse is present. 
CONSTITUTION: An error square generating 
circuit 44 outputs the sum of squares of the 
difference of a tutor signal generating circuit 43 
corresponding to the output of a neural 
network element 41. Further, a timing 
generating circuit 47 controls the input pattern 
switching of an input signal generating circuit 
42 or the timing of a weight and threshold 
control circuit 45. In this case, plural pulse 
signals having only one pulse at the same time 
are superposed on the weight or threshold 
output value and the resulting error signal is 
latched in synchronism with the time when one 
pulse signal is generated to find the difference 
from the error signal when all the pulse signals 
are not generated, thereby directly finding the 
variation of the energy function accompanying 
variation in the corresponding weight or 
threshold value. 
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^ay^^\zmm^tzmm<D/vi^^x$>K). *o 
ft-mnz\mm$t<D'vi7>^<D*frt> i oonjw 

^©^smars/wxa^Bs^ai. 
mmmmn%&.^m<Dti\tizwvi>x%!k¥mz&r)i}i 
jizntcWvixfsmzmMLx, mxmbmt&m 

m&ft¥&(Dtiit>1SmzfoVTm-3.-y)V*y hV- 
St, 



k t%> l^©ra-7My h7-^ffl:*}#- 

ftfrfciaacfflaxi^^k &$&axi^>h£ffi 
at, »A*fi^ic»j6bfciasiffi^*56±-rs«siiffl 

n<@©iS3^^/'^->S-?-n-?nPl , P2 , P 

n tu ms&n^w-xDMmifi, 

Pi = {Pil, Pi2, ■», Pirn} (Pik= ±1,1 ^ 
k 2sm ) 

20 t-tzt, smtmnnz-y-tfi, 



2 Plk=0 



(1 ) 



flO 



2 PjkPlk=0 



#o 



2 PikPik=m 
i- 1 



■taa-rsa^aa^at, 

aXft*/1*->SR*L-rV»&V>i*©K«*«8# 
R©ffla£««Xff*/^->«4*a©»««ra/^ 

ufca*£iin***jq*#afc. 
a***v»ttH«x*s*M-r5/^5^-^iiiHP#a 

»aassw^^->o^< tt> i H«©w*n-6tt 
©asasu «ax«F^^->©i«jB©a»ta 

WLt*<StSZ\b*®mt?Z7-)-u>f-3L-y)l*y h 



(1 , UI £d ) . 1 *j 



7-^W®&. 
30 [R$JH3] S»©-a-7Myh7-i'AA#- 
k 4>£< lOO=a-5**9 h7-^fij##- 

SfT&3*»©8L«xi/ji>k «*B«xW*>h£ffi 

sic»arr*a»©is»xi/^>ht, st-a-7^ 

at, «x*«^ic»jsb&«Bii«fi^*«§i-r*«B»a 
^ig^^at. K-a-^w-y h7-^©m*m^t 
sjtauT»a«**a4"r*«aia*!6 
^at**tr=3L-9**» h7-^t:»»*n** 
40 w®m\z&^xnm<Dm#ftnrt?->& j tn?npi 

, P2 , Pn iU tt*&*Wt*->©eai 
Pii={Pil, Pi2, Ppim } (Pik= ±1, 1 



2 Pik=0 



(1 ) 



Ao 
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2 P]kP]k=0 (1 ; 
i-i 

■ 

S PikPik=m 
i» i 

>&3-^R£. 

WWi«*5I^R©ffl*«***ny*ff*fc|!MIL 20 

TfiWr*fl»«8*Ri, 

tK«*(SW*R©ffl;&«*fc«ltXtf 

Ufc^*&lnS-r?.JD^¥R<!:> 

tttn**R©ffl*fcJ&CTKx»-9;k*y h?-?© 

fi*»S^B««X*S*!E-r5A9^-^«IP^R 

[00 0 1] 

[£H±©fW#lf] *»Wtt. 7i-u{f=.3.-7)V* 
v h7-^©*W@»KM"r*"b©T**. 
[00 0 2] 

[«£*©&«] a*, xaR^cnn**, #*§ms£ 

->B», fllBH. »aMfcWI»P©Ann©»IBiS»lt!IMK 50 

»fa©AtH*»tts»*fc»Jc. xiH**#Jc*i;Trt 

[0 0 0 3] 09(J3i^a-7^yhy-^0i)« 
tSf. 09 ©(a) »3S/1~ fe7hD>fticU 40 
©(b) tt=a-D>3(lf0l)S*^t. NH (a)IC^-T 
=a-^*yh«7-*tt, fcJIXASBfF 1 - 1 ~ 1 - 
4, A*B2, +MS3, tti*H4, m^ai*ffl^5- 

i~5-4. Rzs=.x.-uymT6&K>ffif&zn%o m 
0(b) ic^nsxi-n^ss^fajKiaadiastHSc 

i i~ i n n-encs^o &i*w i ~wn s*» 
*»«f tt±iBa[»adi*2©ffl*fcH»aa*«i/. -5- 50 



in , 1 £J ) , j * J 

©ifg**a*T^= =a-Q>«f®Hi*Oli 
0=f (XI iWi + fl) 

ta-S*. tUT?, M&f«> HRfc*llfcPI*T* 

HH*tpf«n*aT©»©w*sji«fflir»6n*. 

S(x) =1/ {1 + exp (-x/a) } 

cut, attHft©«#©^Sfcfc»*/'«5*--* , c 

&S. 0 9(b) O-a-a^SlftHHW ©iifcl 
ttfcBRU #JilBl©=a-D>«^H±ft||-&-r*c 
itiot, ^iZa-7M?h7-i'^i^tl 

*uwffl*tm»©ta*t©«» awe *s#=a- 

[0 0 0 4] HI 0IJ7tD^-a-7J^y 
£*^tt*?^©xa»*©xa*?l 1. *^©« 

*srA*-r?.A^«^i 2, m*m^*Hi»"r*ffl** 
HI8S14, wfiucffla-r^ai^^ftip-rsKffiiiissi 

5. m^HISS 1 4 S.tXBafitIaIS& l 5©tti*SiUjU/&ia 
*Sfflrt"r*JO*@»l 6, JgglHljJSl 6©ffl7J(CM-r 

I7*6«j«*n». *R*mi4*£Zfll«BIftl 
5©ffl*«KttJPJW5FISl 6S^UTJP**n, 

[0 0 0 5] ±JB©.}:5fi:#i=a-7Wy h*7-^ 

5. 

[000 6] AWl=-T)-5E/aWi 
E=l/2 £ (O. -T, ) 2 
CUT, AWitta*»*^fiBMtWiffliijE*, ntt 
^©^W©#W^S*a-r#W«Sc, E«x*;i/*-M 

[0 0 0 7] ±E*l=a-7A*j h7-*©#S» 
fP*3>Ki-*->$a^-->3>-r**&K:tt. — R 

Ktra-Pi'ifOAtBAWy^t'f KHftTife 
•St&JgbT, ±jftft»6fi***V»ttHI«*-t©**H 
1 OCStipCTtn^a-?^^ N«7-^*^ 
fc**.Tt>. JK^OSJHbHS. Mffimft. ft^fi^H 
»*4@l»©»ttlctt. t7t»HW)tf6'3*)W« 

RSfcK fllot. C5Ufc«50*©***^te»t 
Tt>iEb^*»»fP*ff*t>**fc*fcW:. fflS©3ErSi 
T, x*;i^-Hft©«fl2» 5 E/ 5 W©te£E&a9£ 
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[0008] dE/dvrzmmmm-rz^mtLT, 
h7-^®*»ftSHi nc^-r. z.n\t, t. 

Mat sumo to, and M.Koga, "Novel learning method for a 
nalog neuralnetwoks, " Electron. Lett. .vol.26.pp.il 
36-1137, lMOfcflKRSnT^S. 01 l©(a) 
»jg»^tS^<r:a-7^y r»«7-**g|ll»©« 

a.-7)l*y bV-9m?2 1 ^©X*fi^56*0» 2 
2, Aaffl#564@»©»^K*fffrr«*»»#»g=DH 
S&2 3, h7-f* ; F2 l©#|fl*tjit 

J6-r»«»fi^»*lHl»2 3©#m*t©S4)-©2*» 

(.2%mm *a*i--&K3S2*»«±@»2 4, 
• mMifPBB2 5, *--w«*©iEK»£tHrt-r*» 

ig@& 2 6,2 t30A*©9l£Hi#-r<&**IIW& 2 7 , 
A*ffi^©&Ei&£#©*£ffi#r*ffiM7^;i^[Hl8S 

2 8. A*flnj©jEftftate**Tffl»'r*'f>A-^ 

2 9. A*li^^Btra«^T«^Lfcffi*m^-r^«^ 
01830. 2 0©A*©?P*tr#-rSlni^IiI8S3 1 {C<k 

[0 0 0 9] ^a^-Ktt*iJfllflISS2 5tt*ft 

*, »*^tt««A*fc»«*nT^*. &fi 

*, HfllWfPliI»2 5K»tt*nfc*l8iatt2 6tt^T 

sv»caa:ofc«»ftTr*i8-r*"b©tr*. £ 
a* - mmmw®n2 5*<D&®7j)i?®&2 8©js 

Brffittfttt, «fi@WS2 6©B»»«[»niHK:lt'<T+ 

#K:fi<K5&£nst>©tr*. £©t£. £S*«h 
««ii@»2 5©*©itj©»»ii» (amb. mm. 

^sii?2 i©&HWjJBfcfc«U Sfc«KSII&2SlflJ38 
±DH»©mAH:|g»©««*»6ifl6^&«fc5tC. =*- 

ot, ±E©S«b****T*ntf. «S2*»«±® 
H2 4©jqttftg©A^©fiffb ' £b£©Jttt, ft* 
**t»«Bllt©«*a*flsfcJ:r3T4t , *x*^-H 

*©*ft«-©ift««. -r^b^ i 5e/5wi *mam 

##¥21 &zm& 2 mta%tk®& 2 a sua© 
&*@m£&tsi-rn«. shrbr2 6©ta^t^M2* 

ftlft£|en&2 4©«*Rg©|jt»©m*t*tRI«T*n 

[ 0 0 1 0 ] mm g ©j«»*»r« 3 nfc«* 2 mftis 

£®B2 4©W*«. • W«fWSPlHlR2 5 IC#BB 
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sn, mn®&2 7-c%n®&2 e ©!»»£*** 
tu &®7j)if®&2 8*mm-r5z\t\z&Q, mm 

25^©*, 3E/awteJt«Lfcffl**«sin. »©« 
•raiRfc««n&v». znmii*^ yn-$ 2 9 tith 

Tmft®%>Z0\Z\t)?Z>Z\t\Z&?T, «#IeIR3 0 
©ta*tt¥fi»HI^&0, dE/dWlZltMLrcmJEZ 

»*«»©*««» braiififcftfrr*. seoT. d5 

Lfc»^T%>#«»III»*»»'D*S«l6tt-€-©**fii& 

©a* • Hiij&wfcfciEsns&fc. 

[0 0 11] 

Ttt, *ffiailft«*r*«»H»©*7i:y htfifi* 
*«W*HR©RiElClMrr*fci&. *7tj/W*« 

[0 0 12] *5gBJ©S6<J«. a»H»*fflV»"f*7-fe 

^^hhrsriw* etc**. 

[0 0 13] 

-£A##-K M<ttl^a-7M'^7 
-*ffl*#-k A*Sn*fll<JK»UT«*f*t«B* 
*#«*R«fTfc3**©R»xi'.?i>k g&fflx 
JO l/^>h«»SlclttW*1l*©IS«Ucw^>hfc, K 
X3.-5JP*y h7-^fc*^T*B-r^#A*«^& 

«A*R**fc#£L& 

n**S0»t*v»T, ^o^i/m^ti^wbfcfflis:© 

ft©*?5>e> 1 t3©/WA»#©#£iaa-r*/wxR*i 
40 K&mmt, ttRseff^B^aoaasK/w*** 

fln***#a©iH*«fia«-*flM9^at. ^«8^a 

*^i4mtA**«K-r*/x5^-*«!«^at. tsx 

■r*»mi©Btt*n-«i©««fia»b, k»is©a;vx 

«^©ffl*©B*fti»=a-?;U*y h7-7^©A* 
•*©«D»At*H»S**HJi*»a:**tr7^P 
50 y=a.-5^*yh7-^*B0»t«(W*. 
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h 4>l3.<t% l-D<D-a.-y)V^v b v - # in fift- 
hs xtiznzm^zttbTmfrwmn^ftmB&w 

at. m\t>m^\zttfo\sTcmbmn*%£-r*%mm 



1 , P2 , -, Pn tU Ki6X«F*|/t*->©Bai 
j&t. Pi = {Pil, Pi2, Pim} (Pik= 
±1,1 ^k ) 



z 

k-l 



Pik=0 



(1 ) 



2 PJkPik=0 
i-i 



2 

k-l 



PikPlk=m 



*fi*fc|P|»LTfiU*r*ffi^«#^ad:, it£flF*/t 

nw-y&mwvtzmm&isa&rzmn&mt. mho 

KE£?!W^->©4>&< £ *> 1 Hjw©ra-tn-£n© 
tt£«#U KS3fc^/**->©lHM©IBJ6fcRx 30 

[0 0 14] *fc»*53T«, «StOZa-5W?iK 



(1 . 1 ) , i *j 



jsniic^#*»ja«*fftt5«[ft©«ii}xw^>h, sua 

axU*>h£ffl5lC»«-r*«R©l8*Xl'*>h 

9-^©ta*fln»t**awt^t*jt«LT«afln»* 

*->£-£*V?ttPl , P2 , •«. Pn fcU 
>©IH5!I**, 

Pii={Pil, Pi2, Ppim } (Pik= ±1, 1 
^k =£m ) f?Z>£. #HGfcrt*->!iS. 



2 Pik=0 
i- 1 



(1 ) 



do 



2 PJkPJk=0 (1 Si , 1 £n ) , j * J 



k-l 



2 PikPik=m 
k-i 



>fe±m&t, «Rs«^5fift#a©a*ffl#*^ny 

#a©a*fli^fcKits«w/x^~>*jiuitfcis** 
iq^-rsjnff^at, *ji«t#a©ffl*c*i;T«xa 

t h i ««i©iw*n^n©tt«iR# u twaawt* 



->©l»«I©BM6t«X3.-5;P*?/h7-^©i»0 
#A &n)HS«« rawest S-^tr. 

40 [0015] 

;vxfc*H-«»«*bTirJ**ft©^;^ffl^*a***^ 
^«#©lojS»58-r-5l*Wt:H«!bT. RfftS7y 

50 S^hlCcfcoT, AaflWK*frsx*;i/*-Mft©36 
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£T©A#m^fc»LT¥W»ff*frfc3 
[0 0 16] Sfcfc. *»Wtt, Bf3fe©*fr**Ji-r*it 

lit, n6nfc««ffir^t«F^^->*»*bTv» 
ft^«*«^t©*»«^**ffli/, ■€■©*»**&* 

fcjnjrracifc«fcD, Aafc^fc^Tcx*;^- 
M&©^te#dE/dW£ii[g=*(&5. ££>(;::£:T©A 
Afc^K»bT#JSr*x*jl^-H*©*fc0-£* 

[0017] sfc, f9fj£o*fr&*ja"r*ai 

m&tbZo 3 Sfc£T©AAft*KttbT*Mrr*X* 
JI^-W*©*fc#SsR«&. *Olt*K»^V»T»J(rt- 

*a*»snttiai«[m*s«iiE-r*ta:K«fco, -r^x 

[0 0 18] 

*3\ 4 2IJ7tn^-a-7W7 h«7-2j*?4 1 
^©A*ffl*B£®i&, 4 3 «A#f&^fg£lHlS&4 2 IC 
»*-rS*HI©#Offi*lHl»T**. *fc, 4 4»R|g 

ow* t »«-r 4 3 ©g#© 2 ma 

^W^-T-So S&. 4 5»M*-pgfii$iJI9lHl^T*D, 

<5>:?fg£|IIi$X&i9. A#{g#fg£IHi&4 2©A;tJ 

• BMHMIPI3I&4 5©* 

[ 0 0 1 91 H 2 tt, • MttWfPlaIK4 5 ©*)&£ 
*T0T*£. 14 lftrt;^»±0IS"C»D, 

*m*-rs. 1 4 2- 1. 1 4 2-2{i7>>?[U!STS> 

TZmmZft-Z), 1 4 3- 1, 1 4 3 - 2 ttX-f y^T» 
*0. 94 5>^«^ON©B$(CXi'y5 L *ON[Cb 
X» Aaflre*-t©**Htfrr*. 14 4«+fl]©A* 
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4 6ftONfcLT, A*m^Sr-?"©^*W*-r^. 14 
BPgllKTafeO, 2 ^©Artfi^flDg-r*. 14 9H 

^S$xa&0> /u*»4H*i4i©ffla****tt 
1 5 ottnuiwcfcD, 2o<DAi3<Dmm&-? 

5. 

[0 0 2 0] H3«C*Siat«fc*»J«#«*©^-f5> 
20 ^©-«**1\ HBfc*V»TIN-l~IN-3f4A 
*m^584@»4 2*»6«»snaA*^. OUT- 
llta-W*? h?-**^ l©WAffl^. TE 
ACH-ltt«Sf«^»±HJ»4 3©m*©^, E2« 

«S2*ft»4ii»4 4©m***-r. 

sYNiw-r 5>y^0s§4 7*^m*$n*io© 

A*A^->Ki(fr**wft^©iw»*sr3^f s >? 

am. P-l~Pntt#«*-BHMIllHK4 5*©rt 
;VX^E8S1 4 l*»&©ffl2jflrefc*U w- 1~W 
- n «Jn»@SS 1 4 7 ©m^xa*. 

20 [0021] ia©±^©is^ i ~ 8 », -en-en 

l^©A*/X^->«tff»*n*JMIBI**b. ^©il# 

fg£HI?Sl4 l(JSYN(lf©*0^n^TO^f 

(CLK) fcHJWbT. lSia/WX&fiaftl 4 1 
M*»J©*oy**MI» 2SB©/W*3B£|g»i 4 l 
tt2SB©^Py^^S8t^5«t5K l^a-y^ft 
\Z 1 0©/1JU*fg£[HlSS 1 4 1 *»/wa«**fflAT 
*. A*tt^»4®»4 2*J:t;«[Wfll^58±ig»4 3 
50 tt^T©/i;PA564i|HlK 1 4 1 7$VUl^ft*f £ffi# LX 

H-©x*^^->**tfcnfc»jsr*twii 

/^->£&f#LXV>6„ £©&», 94 5.>?m£.® 
8S4 7tt. «*®/W*»*BII©A»*«*Wttaa 
tlfc^, LTCH-Em^SrSWLT. • B3fl{&] 

5 fOM 1 4 6 SON t UT, MXEM 

1 4 8 \Z&& • Ktt^IEff^fcA* LX, S*fc<5 Wi 
H««Brr<&fcfct>fc, AA«WM-0*4 2 fcA* 

A*. ■*©«. *"fS>y»£B»4 7 
40 MfPI§IR4 5tcBrXSYNM^&Siai-r5::i:t«fcO, 
• MttflflfliaiM 5tt, *©trftfcA*/t*-> 

[0 0 2 2] ^< 5>^56±®»4 7©|i5S8ffi^ (SY 
N) tt. #S*-Hi[S!l19llI?S4 5©7-y5 1 tsIiiSl4 2 

- 1 ttti&sn, • HttK:/^^*a*-r*jtt©« 

2 *t1-^T©a* • S9fitMfflHI8S*©7 y 1 4 2 
-lfc^yfSn*. -3Er. i #@©S* • Mffi^JffllsI 

Hfw/^i'^w^iaiSi 4 z. 
50 ©;i;^(iiSi©a*'KIfitiIWlHl!S4 5 4'©7 75 L 
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Egg 14 2-2 tC«iSi&^n, ifBOl*- HlftMfPIal 

±tf 1 4 3 - 2 fcfti&sn, x-fyf 143-1 *s±r; 

1 4 3-2#£fct£ON#fi!£fc07y? 1 HlS&14 2- 
1, 1 4 2-20fltW§l*JWa»l 4 4fc»*n«. 

d, §i^®ki 4 4©a*m^7^5 i sn5. 

5T, HJQffi* (SYN) tHrtWlCtt, £T©/WX$B 
^ffl^^^tJ, i #g©/W<Xfg£[§]|& 1 4 1 ©tttfj© 
5. fiEoT, 7yf@»14 5C5yfSn5fiftt. 
yfWto 14 5 C?yfSn5fiff4. ±T<D/VIX& 

nfc*«TO«J623IWl©J6»**-rctlC3!i:*. fto 

tt. «*£**fc*fca-frfci$©Kfg2 *»o*fc#T 
• aE/3W*e»*UTVi-5J:tC^5 (D 
tt&M) . tot, 4 sottftftfllftllK 

i 4 8^it, ifcEtt©«***v»ttHi*KJn*i/T 

fc>n*;i<i:K:&3. ****W4H*©#HEttLTCH 

-f ? 1 4 6 atoNtfsgtfc o > 4teE-r^#«[3WnJH3 
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